Implementation of the Five Qubit Error Correction Benchmark 
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The smallest quantum code that can correct all one-qubit errors is based on five qubits. We experimen- 
tally implemented the encoding, decoding and error-correction quantum networks using nuclear magnetic 
resonance on a five spin subsystem of labeled crotonic acid. The ability to correct each error was verified by 
tomography of the process. The use of error-correction for benchmarking quantum networks is discussed, 
and we infer that the fidelity achieved in our experiment is sufficient for preserving entanglement. 
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Robust quantum computation requires that information be 
encoded to enable removal of errors unavoidably introduced 
by noise Thus, every currently envis- 

aged scalable quantum computer has encoding, decoding and 
error-correction procedures among its most frequently used 
subroutines. It is therefore critical to verify the ability to im- 
plement these procedures with sufficient fidelity. The experi- 
mental fidelities achieved serve as useful benchmarks to com- 
pare different device technologies and to determine to what 
extent scalability can be claimed. 

Liquid state nuclear magnetic resonance (NMR) is cur- 
rently the only technology that can be used to investigate the 
dynamics of more than four qubits [^, [l(J. Although it is 
not practical to apply it to more than about ten qubits [jTT|], it 
can be used to investigate the behavior of quantum networks 
on representative physical systems to learn more about and 
begin to solve the problems that will be encountered in fu- 
ture, more scalable device technologies. In this Letter, we de- 
scribe an experimental implementation using NMR of a pro- 
cedure for benchmarking the one-error correcting five-qubit 
code. This is the shortest code that can protect against de- 
polarizing one-qubit errors [|l2[ |l3|] . The experiment is one 
of the most complex quantum computations implemented so 
far and the first to examine the behavior of a quantum error- 
correcting code which protects against all one-qubit quantum 
noise. We discuss the principles underlying error-correction 
benchmarks and offer a sequence of specific challenges to be 
met by this and future experiments. The ultimate challenge is 
to demonstrate the ability to reduce the destructive effects of 
independent depolarizing errors. This seems to be out of reach 
of liquid state NMR experiments. Our experiment shows an 
average polarization preservation of 67% corresponding to an 
entanglement fidelity of .75. This easily achieves the goal of 
demonstrating the preservation of entanglement in principle. 
The five-qubit code. A quantum error-correcting code for 
encoding a qubit is a two-dimensional subspace of the state 
space of a quantum system. In the case of interest, the quan- 
tum system consists of five qubits. The code, C5, can be spec- 
ified as one of the 16 two-dimensional joint eigenspaces of the 
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Here, , , are the Pauli spin operators acting on 
qubit k. This is an instance of a stabilizer code [|l4[ [l5|], and 
the fact that it can be used to correct any one-qubit error is due 
to the property that every product of one or two Pauli operators 
acting on different qubits anticommutes with at least one of 
the operators in Eq. ([[]). 

A typical application of a quantum error-correcting code is 
to protect a qubit 's state in a noisy quantum memory. As im- 
plemented in our experiment, the procedure begins with qubit 
2 containing the state to be protected and syndrome qubits 
1,3,4,5 in the initial state |1). A unitary encoding trans- 
formation is applied to map the two-dimensional input state 
space to the subspace of the code C5 . In the application, the 
five qubits are then stored in the noisy memory. In our exper- 
iment, we explicitly applied one of the correctable error. The 
information is retrieved by first applying the inverse of the en- 
coding transformation to decode the state. The properties of 
the code guarantee that if the error was a Pauli operator acting 
on one of the qubits, which one occurred is reflected in the 
state of the syndrome qubits. To complete the process, condi- 
tional on the syndrome qubits' state, it is necessary to correct 
the state of qubit 2 by applying a Pauli operator. Quantum net- 
works for encoding, decoding and error-correction are shown 
in Fig.0. 

Benchmarking quantum codes. 

The purpose of a benchmark is to compare the performance 
of different devices on the same task. Since quantum codes 
will be used to maintain information in future quantum com- 
puting devices, they are excellent candidates for benchmark- 
ing the reliability of proposed quantum processors. A basic 
quantum code benchmark consists of a sequence of steps that 
implement encoding, evolution, decoding and error-correction 
networks. In the simplest cases, the steps are applied to one 
qubit 's state using several ancilla qubits for the intermediate 
steps. An experimental implementation measures the reliabil- 
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ity (see below) with which the qubit's state is processed. It is 
necessary to include a means for verifying that a code with 
the desired properties was indeed implemented. For error- 
correcting and for stabilizer codes, this can be done by insert- 
ing 180° pulses applied to individual qubits in the evolution 
step and observing their effect on the output. In this case, 
the verification relies on the assumption that such pulses can 
be reliably implemented, a property that needs to be indepen- 
dently verified. 

To allow for unbiased comparison of devices, the reliability 
measurement and the verification steps of the benchmark need 
to be standardized. There are many different ways of quantify- 
ing reliability. The best known such measure, fidelity, is based 
on the geometry of the state space. If the input state is and 
the output density matrix is p, then the fidelity of the output 
is given by F(\ip), p) = This can be seen to be the 

probability of measuring \ip) in a measurement which distin- 
guishes this state from the orthogonal states. In our case we 
are interested in an arbitrary state of one qubit. One quantity 
of interest would be the worst case pure state fidelity, which 
minimizes the fidelity of the implemented benchmark over 
pure input states. However, an easier to use quantity is the 
entanglement fidelity F e Jl6|], the fidelity with which a Bell 
state on the qubit and a perfect reference qubit is preserved. 
Entanglement fidelity does not depend on the choice of Bell 
state and has the property that F e = 1 if and only if the process 
perfectly preserves every input state. To avoid experimentally 
implementing the reference qubit, F e can be determined from 
the fidelities of pure states. Define |±) = (|0) ± |1»/a/2 and 
\±i) = (| 0) d= i\l))/y/2 (the eigenstates of a x and a y , re- 
spectively). Let F s be the fidelity of the process for input \s). 
Then 

F e = (F + F 1 + F + + F_ + F +l + F_,)/4 - 1/2. (2) 

We advocate the use of entanglement fidelity as the standard 
reliability measure to be given when describing the results of 
a quantum benchmark involving processing of a quantum bit. 

The standard verification procedure for a quantum code 
benchmark needs to be such that sufficiently high fidelity 
cannot be achieved without having implemented a code with 
the desired properties. For codes defined as the common 
eigenspace of a commuting set of products of Pauli operators 
(stabilizer codes), it is in principle enough to verify that ap- 
plying a product P of Pauli operators during the evolution has 
the expected effect on the output, namely that it differs from 
the input by the application of a Pauli operator cr(P) deter- 
mined by the code and the applied product. A single fidelity 
measure may be obtained by applying cr(P) to the output and 
by averaging the resulting entanglement fidelities over all P. 
To make this procedure experimentally feasible, one may ran- 
domize the choice of P and use statistical methods to estimate 
the desired average. 

For benchmarks involving a quantum error-correcting code, 
the emphasis is on having corrected the set of errors £ for 
which it was designed, and verification involves applying the 
errors in £ during the evolution and observing the extent to 



which they are indeed corrected. Ideally, the errors occur nat- 
urally in the course of evolution, and one would like to see 
that information is preserved better by encoding it. In order to 
investigate the code in a controlled way, it is easier to apply 
different errors explicitly and observe the effect on the relia- 
bility of the process. The experiment described here involves 
measuring the entanglement fidelity for each of the one-qubit 
Pauli operators applied during the evolution. 

When implementing a benchmark, it is useful to have some 
goals in mind. Each goal implies the demonstration of a non- 
trivial result. For benchmarks involving codes designed to 
correct independent errors on qubits, we offer a sequence of 
four such goals depending on how well the implementation 
succeeds at protecting against various error models. Most in- 
volve comparing the entanglement fidelity for two situations 
involving a specific error process £i. In the first, the infor- 
mation is stored in any one of the qubits, giving an opti- 
mum F ej i(£i). In the second, the information is stored by 
using the implemented code, giving an experimentally deter- 
mined F Gy c(£i)- Numerical goals for F Gy c(£i) are given un- 
der the assumption that the implementation induces depolar- 
izing noise. The goals are: 1. Improvement where £\ is depo- 
larization of each qubit with some probability p. For C5 under 
the assumption that the error behavior is identically depolar- 
izing (quantified by F Gy c 5 ) for each possible Pauli-product er- 
ror during the evolution, this requires F Gy c 5 > 0.97, giving 
an improvement when p = 0.08713. See Fig. ||. 2. Im- 
provement where £2 is the process that first randomly chooses 
a qubit and then depolarizes it. For our code this requires 
F e ,c 5 (^2) > -85. 3. Preservation of some entanglement for 
£2. This requires F e> a (£2) > .5 JT^]. 4. Improvement in 
the presence of the demonic error process £4 that, knowing 
the method for storing the qubit, chooses the worst possible 
one-qubit depolarizing error and applies it. In this case we 
need F g ^c{£a) > -25. One of the ultimate goals might be 
to demonstrate that the code can be implemented sufficiently 
well to permit preservation of information by means of con- 
catenation. 

Experimental implementation. We used 13 C labeled trans- 
crotonic acid (Fig. j|) synthesized as described in [17], but 
with deuterated acetone as a solvent. A standard 500 MHz 
NMR spectrometer (DRX-500 Bruker Instruments) with a 
triple resonance probe was used to run the experiments. The 
five spin 1/2 systems used for the code are the methyl group 
(M), CI, C2, C3 and C4. The methods of ^ were used to 
prepare the methyl group as an effective spin 1/2 system and 
to initialize the labeled pseudo-pure state la z 11111 on all 
active nuclei. Here, 1 = |1)(1| and the last two nuclei are HI 
and H2. The selection method was based on gradients, and 
the pseudo-pure state was subjected to a "crusher" gradient. 
To absolutely guarantee the pseudo-pure state, more random- 
ization is required (see [|l7|]) but we did not implement this. 
HI and H2 were not used and were only affected by some 
hard pulse refocusings on the protons. The state of HI and H2 
(up or down) induces an effective frequency shift on the other 
nuclei depending on the coupling constants and was compen- 
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sated for in phase calculations. To greatly reduce the effect 
of radio frequency (RF) inhomogeneity, we used the nutation 
based selection scheme of [|l7|], applied to both the proton and 
the carbon transmitters. The quantum networks of Fig. [j]were 
directly translated to pulse sequences, again using the meth- 
ods described in [ |l7| ] . The only significant use of manual in- 
tervention was to place the refocusing pulses. The evolution 
period between encoding and decoding was carefully isolated 
from both the preceding and the following pulses: It imple- 
mented the identity unitary operator, or one of the one qubit 
180° rotations by refocusing the molecule's internal Hamilto- 
nian and applying an extra inversion or by shifting the phase 
by 180°. The qubit's output state appeared on CI at the end 
of the experiment. The peak group associated with CI was 
observed in each experiment. Spectra were analyzed by com- 
paring the spectrum of the pseudo-pure state la x 1 1 1 1 1 to the 
output, using the knowledge of the peak positions and shapes 
to compute relative intensities and phases. No phase adjust- 
ment was made after phasing the pseudo-pure state spectrum. 
This was possible since the relative phase is precomputed by 
the pulse compiler and integrated into the acquisition. 

We performed one experiment for each of the 16 possible 
evolutions with one-qubit or no Pauli error, each of the three 
initial states cr x , a y or a z on CI, and each of three observa- 
tions (no pulse, 90° X pulse, or 90° Y pulse) on CI. This 
resulted in a total of 112 experiments, each of which was re- 
peated sufficiently often to get better than 8% error in the in- 
ferred state of CI. For each evolution E and input a u , we de- 
termined the amount of signal P(e, u) in the correct direction 
in the output relative to the input signal. This requires "tracing 
out" the other spins, which was done by adding the intensities 
of each peak in the CI spectrum that is associated with the 
11 state on HI and H2. (The spectrum of CI resolves all its 
couplings.) Thus, except for noise, —1 < P(E,u) < 1. Un- 
der the assumption that input 1 11 1 1 1 1 1 results in no observ- 
able signal, the entanglement fidelity for a given evolution e is 
given by F e (E) = (P(E, x) + P(E, y) + P(E, z) + 1)/4. We 
did not verify the assumption in this experiment, but note that 
it has been verified in related experiments [|l8|], and could be 
enforced by modifying the process with random pairs of can- 
celing 180° pulses before and after the implemented pulse se- 
quence. This would also enforce the depolarizing noise model 
for the implementation while preserving the observed polar- 
ization. 

Results. Typical spectra compared to the spectrum of the in- 
put pseudo-pure state are shown in Fig. [|. The relative po- 
larization after the error-correction procedure in the correct 
output state varies between 48% and 87%. The distribution is 
shown in Fig. |[ The inferred entanglement fidelity for goals 
2 and 3 is F e ^c{^2) = -75, with an estimated error of less than 
.02. Thus we clearly met goal 3. 

The reduction in polarization is due to thermal relaxation, 
incompletely refocused couplings (part of the pulse com- 
piler's optimization trade-offs), pulse errors due to non-ideal 
implementation of 180° and 90° pulses, and RF inhomogene- 
ity (less than 2% after our selection procedure). Most of the 



error is explained by the known relaxation times, suggesting 
that this is what limits the fidelities that can be attained using 
liquid state NMR. We note that the estimated phase relaxation 
times of well over a second are high when compared to those 
of nuclei in other molecules used in NMR quantum informa- 
tion processing experiments to date. 

Discussion. Benchmarking quantum devices for quantum in- 
formation processing is crucial both for comparing different 
device technologies and for determining how much control 
over a device is achievable and how to best achieve it. Given 
the need for and difficulty of achieving robust quantum con- 
trol, we advocate the use of quantum coding benchmarks to 
determine the fidelity of the implementation of standard, veri- 
fiable processes. Unlike the experimentally implemented ver- 
sions (up to 5 qubits) of the popular quantum searching and 
order-finding algorithms [§]| |g |l[ ||| @1> quantum 
codes offer a rich source of complex and verifiable quantum 
procedures required in currently envisioned quantum com- 
puter architectures. Liquid state NMR has been used to im- 
plement several interesting, small quantum codes ^3j\ 9 
and a seven qubit cat-state benchmark [p7||. In this letter, 
we have given specific goals for benchmarks involving error- 
correction and, for the first time, implemented a one-qubit 
error-correcting quantum code. The fidelity achieved is well 
above what is needed to demonstrate preservation of entangle- 
ment in the presence of a non-trivial error-model. It is unlikely 
that the goal of showing improvement in error-correcting in- 
dependent depolarizing errors is achievable with liquid state 
NMR. A device that achieves this challenging goal will be 
well on the way toward realizing robustly scalable quantum 
computation. 
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FIG. 1: Networks for the 5-qubit code. Top: The encoding network 
using 90° rotations. Except for refocusings required to eliminate un- 
wanted couplings, these are directly implementable with pulses. The 
decoding network is the inverse of the encoding network. Bottom: 
The three steps of the error-correction procedure, which implements 
a rotation on Cl conditional on the syndrome state. The controlled 
operations can be translated to sequences of 90° rotations using stan- 
dard quantum network methods 
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FIG. 2: Entanglement fidelities for independent depolarization. The 
fidelities for an unencoded qubit (straight line) and a qubit encoded 
with C*> are shown as a function of the depolarization probability. 
The implementation of the code is assumed to have an additional 
error that is syndrome independent with depolarization probability 
.97. The first three fidelity benchmarking goals are indicated. 
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FIG. 3: Trans-crotonic acid. The chemical shifts and nearest neigh- 
bor couplings are shown. 




FIG. 4: Experimental input and output spectra. The reference spec- 
trum for the pseudo-pure input is at the bottom, and partial spectra 
for each one-qubit error are shown above it using the same scale. The 
labels indicate which error on which nucleus was applied. One peak 
is observed for each possible error input. Its position corresponds to 
the error syndrome. Its phase reflects the error correction procedure 
and corresponds to the input state up to a small error. Signal in the 
wrong locations or phase was consistently small and comparable to 
the estimated noise. 
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FIG. 5: Distribution of relative polarizations. There are a total of 
48 polarization measurements. Each bar represents the number of 
measurements with relative polarization in the bar's interval. The 
distribution strongly suggests some syndrome-dependent effects on 
the implementation error. 



